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STOCEM  INVESTIGATION  OF  COMBAT  SAMPLING  (SICS) 

SUMMARY 


THE  REASON  FOR  PERFORMING  THE  RESEARCH  ANALYSIS  ACTIVITY  (RAA) 
was  that  a  preferred  method  needs  to  be  determined  for  using  Combat  Sample  Generator 
(COSAGE)  samples  in  Stochastic  CEM  (STOCEM)  simulation  applications  at  the  US  Army 
Concepts  Analysis  Agency  (CAA),  including  the  Kursk  Operation  Simulation  and  Exercise 
(KOSAVE)  Study.  Previous  STOCEM  applications  at  CAA  have  frequently  exhibited 
undesirable  behavior. 

(1)  Mean  STOCEM  results  have  frequently  and  substantially  diverged  from  corresponding 
results  from  the  deterministic  Concepts  Evaluation  Model  (CEM)  at  CAA. 

(2)  The  range  of  STOCEM  variation  over  replications  has  frequently  been  excessively  small. 

THE  RAA  SPONSOR  is  the  Director,  US  Army  Concepts  Analysis  Agency,  8120  Woodmont 
Avenue,  Bethesda,  MD  20814-2797. 

THE  SCOPE  OF  THE  RAA  was  to  apply  STOCEM  for  the  scenario  from  the  Simulation 
Enhancements  from  Ardennes  Campaign  (SEACA)  RAA,  while  varying  the  use  of  COSAGE 
samples  and  stochastic  processes  in  STOCEM,  so  as  to  reduce  divergence  from  deterministic 
CEM  and  to  increase  variability  of  STOCEM  results  over  replications.  For  each  case  variant, 
assessment  was  made  of  STOCEM  divergence  from  deterministic  CEM  and  of  variability  of 
STOCEM  results  over  replications.  Closeness  of  STOCEM  results  to  historical  results  was  also 
assessed  for  selected  cases. 

THE  MAIN  ASSUMPTION  is  that  30  replications  of  STOCEM  applied  with  the  SEACA 
scenario  are  sufficient  to  produce  useful  results. 

THE  BASIC  APPROACH  wras  to  devise  STOCEM  application  cases  which  varied  the  types  of 
active  stochastic  processes  and  the  method  for  using  COSAGE  samples  and  to  subsequently 
assess  results  from  these  cases  for  divergence,  relative  to  deterministic  CEM,  and  variability  over 
replications. 

THE  PRINCIPAL  FINDING  was  that  the  preferred  method  for  applying  STOCEM  is  to 
deactivate  the  stochastic  forward  edge  of  the  battle  area  (FEBA)  move  rate  process  and  to  apply  a 
single  randomly  selected  (in  each  replication)  set  of  COSAGE  samples  to  all  simulated  battles  in 
a  replication  of  STOCEM. 

THE  RAA  EFFORT  was  directed  by  Walter  J.  Bauman,  Tactical  Analysis  Division,  US  Army 
Concepts  Analysis  Agency 

COMMENTS  AND  QUESTIONS  may  be  sent  to  the  Director,  US  Army  Concepts  Analysis 
Agency,  ATTN:  CSCA-TA,  8120  Woodmont  Avenue,  Bethesda,  Maryland  20814-2797. 
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Background  for  STOCEM  investigation  | 

*  STOCEM  was  developed  as  a  stochastic  version  of  CEM. 

V  Use  of  deterministic  CEM  should  be  treated  as  an  attempt  to 
approximate  the  STOCEM  mean  of  many  replications. 

*  Several  STOCEM  investigations  showed  frequent  and 
substantial  divergence  of  deterministic  CEM  results  from  the 
STOCEM  mean.  These  results: 

V  may  imply  that  deterministic  CEM  and  STOCEM  are  not 
versions  of  the  same  model. 

V  may  imply  that  STOCEM  behavior  is  extremely  nonlinear. 

-  for  a  nonlinear  mathematical  function  F(x),  expected  value 
of  F(x)  diverges  from  F(expected  value  of  x). 

/  may  imply  that  deterministic  CEM  is  a  good  approximation  of 
STOCEM  only  if  inputs  for  the  two  models  are  properly  aligned. 


The  Stochastic  CEM  (STOCEM)  theater  combat  simulation  was  developed  by 
the  US  Army  Concepts  Analysis  Agency  (CAA)  to  be  a  stochastic  version  of 
the  Concepts  Evaluation  Model  IX  (CEM  IX)  deterministic  simulation.  CEM 
IX  uses  only  fixed  inputs  for  the  processes  which  are  modeled  stochastically  in 
STOCEM.  The  results  of  deterministic  CEM  are  used  as  an  expected 
simulation  outcome  in  many  CAA  studies. 

Several  internal  CAA  studies  (References  1,  2,  3)  have  found  frequent  and 
considerable  differences  between  results  of  deterministic  CEM  and  the  mean 
STOCEM  result  under  a  common  scenario.  The  causes  of  these  differences 
have  not  been  fully  determined,  but  may  include  one  or  more  of  the  following: 

a.  Although  STOCEM  was  intended  to  be  a  stochastic  version  of  CEM  IX, 
design  differences  may  have  caused  some  STOCEM  processes  to  differ 
substantially  from,  or  be  lacking  in,  a  deterministic  CEM  counterpart.  In  such 
a  case,  two  different  models  will  likely  produce  radically  different  results. 

b.  Based  on  mathematical  principles,  for  a  function  F,  in  general,  [expected 
value  of  F(x)]  is  not  identical  to  F(expected  value  of  x).  This  is  always  true 
only  when  F  is  linear.  Substantial  differences  can  arise  when  this  is  not  the 
case. 

c.  Results  from  STOCEM  and  CEM  under  a  common  scenario  can  only  be 
compared  if  the  deterministic  CEM  inputs  reflect  the  central  tendency  of  the 
STOCEM  processes.  If  inputs  are  not  aligned  in  this  manner,  significant 
divergence  can  occur. 
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Backgroun^continued)J 


•  Ardennes  Campaign  Simulation  (ARCAS)  study  used 
STOCEM. 

✓  Variation  in  non-FEBA  STOCEM  results  (over  replications) 
was  often  small. 

✓  Alternative  ways  of  processing  COSAGE  samples  in  STOCEM 
may  increase  variability. 

•  A  best  way  of  using  STOCEM  must  be  determined  for  the 
Kursk  Operation  Simulation  and  Validation  (KOSAVE) 
study. 


STOCEM  was  applied  in  the  Ardennes  Campaign  Simulation  Study  (ARCAS) 
(Reference  4).  Variation,  over  replications,  in  ARCAS  STOCEM  measure  of 
effectiveness  (MOE)  results  often  appeared  to  be  unusually  small  for  MOEs 
other  than  FEBA  progress. 

This  variation  can  be  increased  by  simply  increasing  the  values  of  STOCEM 
inputs  regulating  variation  of  selected  statistical  stochastic  processes  in  that 
model.  However,  analysis  of  stochastic  processes  applied  in  STOCEM 
suggested  that  variability  in  weapon  effects  may  have  been  dampened  to  an 
unknown  degree  by  the  combat  effects  sampling  methodology  applied  in 
STOCEM.  In  ARCAS,  a  single  combat  effects  sample  was  applied  to  all 
simulated  engagements  in  a  STOCEM  replication.  Considering  variation  over 
engagements  not  only  appears  appropriate,  but  may  increase  variability  in 
STOCEM  results  sufficient  to  increase  the  likelihood  that  deterministic  CEM 
results  fall  within  the  STOCEM  outcome  range.  Therefore,  the  SICS 
investigation  focused  on  assessing  variability  resulting  from  alternative 
methods  of  STOCEM  use  of  combat  samples  which  are  generated  by  the 
Combat  Sample  Generator  (COSAGE)  simulation.  No  STOCEM  input 
parameter  regulates  variability  over  COSAGE  samples. 

Use  of  lessons  learned  in  ARCAS  to  investigate  and  improve  the  use  and 
interpretation  of  STOCEM  is  needed,  so  that  STOCEM  can  be  applied  in  the 
ongoing  KOSAVE  Study,  which  has  objectives  analogous  to  those  in  ARCAS. 
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purpose! 


•  Investigate  alternative  methods  of  COSAGE  sampling  for 
use  in  the  STOCEM  simulation. 


The  purpose  of  the  SICS  Research  Analysis  Activity  (RAA)  is  to  develop  a 
preferred  way  to  use  COSAGE  samples  in  general  STOCEM  applications, 
including  the  KOSAVE  Study. 
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Objectives  for  STOCEM  process  improvement 


•  Reduce  divergence  of  STOCEM  results  from  deterministic 
CEM  results. 

•  Increase  variability  (over  replications)  of  non-FEBA  STOCEM 
results. 

✓  Avoid  increasing  variation  in  FEBA  results. 

•  Assess  closeness  of  STOCEM  results  to  historical  (ARCAS) 
results). 


Since  ARCAS  demonstrated  a  considerable,  and  sufficient,  variability  in 
STOCEM  FEBA  progress  results  over  replications,  an  increase  in  variability, 
over  replications  is  deemed  desirable  only  in  non-FEBA  MOE  results,  i.e., 
those  MOEs  which  do  not  measure  FEBA  progress. 

A  secondary  objective  of  SICS  is  to  assess  the  closeness  of  STOCEM  results 
to  historical  results  in  the  base  STOCEM  case,  and  when  alternative  COSAGE 
sampling  methodology  is  used. 
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Approach] 


Using  the  ARCAS  scenario  as  a  base,  the  SICS  analytic  steps  are  to: 

a.  Define  alternatives  to  the  present  method  of  COSAGE  sampling  which  are 
directed  toward  achieving  the  SICS  objectives. 

b.  Define  variations  in  the  use  of  stochastic  processes  in  STOCEM  which  are 
directed  toward  achieving  the  SICS  objectives. 

c.  Define  the  STOCEM  cases  to  be  evaluated.  These  are  defined  in  terms  of  the 
COSAGE  sampling  alternatives  and  stochastic  process  variations  which  are 
applied  in  each  case. 

d.  Define  the  STOCEM  MOEs  to  be  evaluated. 

e.  Execute  each  STOCEM  case  for  30  replications  and  exercise  postprocessors 
to  compute  the  mean  STOCEM  MOEs,  as  well  as  the  variability  over 
replications.  Exercise  deterministic  CEM  once. 

f.  Assess  STOCEM  case  results  relative  to  divergence  from  deterministic  CEM 
results  and  to  variability  over  replications. 

g.  Using  the  SICS  objectives,  select  a  preferred  case  and  develop 
recommendations  for  improved  use  of  COSAGE  sampling  in  STOCEM. 

h.  Assess  STOCEM  results  for  closeness  to  historical  Ardennes  Campaign 
results  when  alternative  COSAGE  sampling  is  applied. 
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Measuring  STOCEM  divergence 
from  deterministic  CEM 


•  Assess  frequency  that  deterministic  CEM  MOE  values  are 
outside  following  STOCEM  limit  bands: 

y  25th  percentile  &  75th  percentile  (over  30  replications) 
y  minimum  &  maximum  (over  30  replications) 

✓  99  %  confidence  limits  (around  STOCEM  mean) 

✓  STOCEM  mean  +- 15%  (of  STOCEM  mean) 

•  STOCEM  process  improvement  objective: 

y  Reduce  frequency  of  deterministic  CEM  MOEs  outside  STOCEM 
limit  bands 


Divergence  of  a  deterministic  CEM  MOE  from  the  corresponding  STOCEM 
mean  MOE  is  assessed  in  terms  of  statistical  as  well  as  absolute  divergence. 
Statistical  divergence  is  defined  as  the  frequency  with  which  deterministic 
CEM  MOE  values  lie  outside  specified  statistical  bounds  surrounding  the 
corresponding  STOCEM  mean,  e.g.,  percentiles  or  confidence  limits. 
Statistical  divergence  is  an  indicator  of  divergence  relative  to  the  full 
distribution  of  STOCEM  rather  than  just  the  mean  value.  For  the  range  of 
MOEs  examined,  divergence  is  computed  as  the  fraction  of  the  deterministic 
MOEs  with  values  outside  the  four  STOCEM  bounds/limits  described  in  this 
chart.  All  STOCEM  confidence  limits  are  based  on  the  Student  /-distribution 
being  applied  to  sample  means. 
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Measuring  variation  (over  replications) 
in  STOCEM  results 


•  Compute  standard  deviation  of  results  (over  30 
replications) 

/  Comparison  of  standard  deviations  is  equivalent  to 
comparison  of  confidence  limit  bands. 

•  STOCEM  process  improvement  objective: 

✓  Increase  the  standard  deviation  of  non-FEBA  STOCEM 
MOEs. 


Variability  of  STOCEM  MOE  results  over  replications  is  measured  by  the 
standard  deviation  of  the  sample  of  30  replication  results  for  an  MOE.  The 
width  of  a  confidence  interval  is  directly  proportional  to  the  standard  deviation 
of  the  underlying  sample  distribution. 

Treating  STOCEM  application  as  a  process,  one  objective  of  SICS  is  to 
modify  the  STOCEM  process  to  increase  the  sample  standard  deviation  of 
MOE  results  for  MOEs  other  than  FEBA  progress. 
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Assessing  closeness  of  STOCEM  results  to  history  | 

•  Use  historical  Ardennes  campaign  results  derived  from  the 
Ardennes  Campaign  Simulation  Data  Base  (ACSDB)  as  a 
baseline. 

y  Quantified  in  ARCAS  Study 

■/  Compare  only  STOCEM  mean  results  for  selected  cases. 

(1)  Base  STOCEM  case 

(2)  Deterministic  CEM  case 

(3)  Cases  using  alternative  COSAGE  sampling 


The  ARCAS  Study  (Reference  4)  and  the  SEACA  RAA  both  compared 
STOCEM  results  from  a  simulation  of  the  1944-45  Ardennes  Campaign  with 
historical  results  derived  from  the  ACSDB.  Those  historical  results  served  as 
an  historical  baseline  for  comparison  with  SICS  STOCEM  results  simulating 
the  same  campaign. 

Historical  comparison  in  SICS  was  done  only  with  the  base  STOCEM  case,  as 
applied  in  the  SEACA  RAA,  the  deterministic  CEM  cases,  and  the  STOCEM 
variants  (described  in  Chart  12)  which  apply  alternative  COSAGE  sampling 
(relative  to  the  method  used  in  the  base  case).  All  STOCEM  cases  consisted  of 
60  STOCEM  replications. 
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Alternative  COSAGE  sampling  | 


•  Current  STOCEM  practice  is  to  draw  a  COSAGE  sample  for 
every  subsector  battle. 

/In  this  case,  mean  theater  weapon  effectiveness  in  each 
replication  reflects  the  average  COSAGE  sample. 

•  Alternative  COSAGE  sampling  is  defined  as  drawing  only  one 
sample  per  replication  for  each  posture. 

/This  case  explicitly  models  variation  in  mean  theater  weapon 
effectiveness  over  replications. 


In  current  STOCEM  practice,  in  each  replication,  a  uniform  random  draw  of  a 
COSAGE  combat  sample  is  made  for  each  subsector  engagement  in  each 
STOCEM  division  cycle  (usually  12  simulation  hours).  This  draw  is  from  the 
replications  (samples)  of  the  COSAGE-generated  killer/victim  scoreboards 
associated  with  the  combat  posture  (e.g..  Red  attack  vs  Blue  hasty  defense)  of 
that  engagement.  Since  a  STOCEM  division  cycle  has  many  subsector 
engagements,  the  law  of  large  numbers  suggests  that  the  the  full  theater  effect 
in  a  STOCEM  theater  cycle  (usually  4  simulation  days)  reflects  the  central 
tendency  of  the  distribution  of  COSAGE  samples.  As  a  result,  the  mean 
STOCEM  theater  weapon  effectiveness  in  each  STOCEM  replication  will 
always  approximately  reflect  the  average  COSAGE  sample. 

Define  alternative  COSAGE  sampling  in  STOCEM  as  the  random  drawing  of 
a  COSAGE  replication  for  each  combat  posture  at  the  start  of  a  replication,  and 
use  of  that  fixed  set  of  samples  for  all  (subsector)  engagements  of  all  division 
cycles  in  that  replication.  With  this  alternative  sampling,  the  mean  STOCEM 
theater  weapon  effectiveness  in  each  replication  approximately  reflects  the 
specific  COSAGE  samples  drawn  at  the  start  of  the  replication.  Variation  in 
mean  STOCEM  theater  weapon  effectiveness  over  replications  is  explicitly 
modeled  in  this  process.  Alternative  COSAGE  sampling,  as  defined  in  this 
manner,  is  also  a  direct  generalization  of  COSAGE  sampling  as  applied  in 
deterministic  CEM,  which  uses  a  single  fixed  set  of  average  combat  samples 
throughout  the  simulation. 


10 


CAA-MR-97-42 


THE  US  A RMrS  CENTER  FOR  STRATEGY  AND  FORCE  EVAL UA  VON 


Stochastic  processes  used  in  STOCEM| 


•  FEBA  move  rate  produced  by  a  tactical  situation. 

•  Decision  thresholds  for  allocation  &  commitment. 

•  Threshold  for  hasty  (vs  prepared)  defense  posture. 

•  Fraction  damaged  vehicles  destroyed  &  abandoned. 

•  Fraction  personnel  casualties  wounded,  hospitalized, 
evacuated. 

•  Weapon  effectiveness  (combat  samples) 


This  list  summarizes  the  stochastic  processes  that  can  be  simulated  in 
STOCEM.  A  more  detailed  description  of  their  definition  and  operation  can 
be  found  in  STOCEM  documentation  (References  1,  2,  3). 
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Definition  of  STOCEM  cases  to  be  evaluated 


'CASE  ID 

DETERMINISTIC  STOCEM  PROCESSES 

COMBAT  SAMPLING 

BO  (base) 

None 

per  subsector  battle 

B2 

FEBA  movement 

per  subsector  battle 

B2 

FEBA  movement,  decision  thresholds 

per  subsector  battle 

B2 

All  except  combat  samples 

per  subsector  battle 

C2 

None 

I  per  theater/replication 

C2 

FEBA  movement 

1  per  theater/replication 

C2 

FEBA  movement,  decision  thresholds 

I  per  theater/replication 

C4 

All  except  combat  samples 

l  per  theater/replication 

DET  CEM 

All 

1  for  theater 

DCS 

Combat  samples  (average  sample  Is  used) 

1  for  theater 

© 


Case  BO  denotes  the  standard  (current)  way  of  running  STOCEM,  in  which  all 
of  the  stochastic  processes  described  in  Chart  1 1  are  activated.  B 1  is  a  variant 
case  which  makes  only  the  FEBA  movement  process  deterministic  (all  other 
processes  are  as  in  BO).  B2  is  a  variant  which  makes  only  the  FEBA 
movement  process  and  the  decision  threshold  process  both  deterministic.  The 
B4  variant  makes  all  of  the  usual  (in  BO)  STOCEM  stochastic  processes 
deterministic  except  for  COSAGE  sampling,  which  is  stochastic.  All  of  the  C 
cases  (CO,  Cl,  C2,  and  C4)  are  exactly  analogous  to  the  B  cases  (BO,  Bl,  B2, 
and  B4)  except  that  the  C  cases  all  select  a  combat  sample  only  once  in  each 
replication.  This  differs  from  the  B  cases  which  select  a  combat  sample  for 
each  subsector  engagement/battle  in  a  replication.  The  DET  CEM  case 
denotes  deterministic  CEM. 

The  Deterministic  COSAGE  with  Stochastic  (DCS)  case  denotes  the  case  in 
which  all  the  usual  (in  BO)  STOCEM  stochastic  processes  are  activated  except 
for  COSAGE  sampling,  which  is  deterministic.  In  the  DCS  case,  the  fixed 
COSAGE  sample  used  in  STOCEM  is  exactly  the  same  as  that  used  in  the 
DET  CEM  case.  This  sample  is  a  composite  average  over  all  samples. 
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MOEs  examined 


•  14  theaterwide  MOEs  for  each  theater  cycle  (TC)  include: 

✓  mean  FEBA  change  &  average  net  FEBA  change  (2  MOEs) 

y  Blue  ammo  spent/TC  &  cumulative  Blue  ammo  spent  (2  MOEs) 

✓  Red  ammo  spent/TC  &  cumulative  Red  ammo  spent  (2  MOEs) 

✓  Blue  &  Red  cumulative  permanent  tank  losses  (2  MOEs) 

y  Blue  permanent  personnel  losses  (by  TC  &  cumulative  2  MOEs) 

✓  %  Blue  force  in  static  posture 

✓  %  Blue  force  in  reserve  posture 

✓  %  Blue  force  in  attack _postu re 

✓  %  Blue  force  being  attacked  by  Red 

•  FEBA  position  MOEs  measure  cumulative  FEBA  progress  (since  D- 
day)  on  each  STOCEM  avenue  of  advance. 


The  CEM/STOCEM  MOEs  examined  in  SICS  are  divided  into  two  groups. 
The  first  group,  denoted  in  the  charts  as  14  theaterwide  MOEs,  comprises  14 
MOEs  from  the  Automated  Data  Display  of  CEM  Outputs  (ADDCOP)  files, 
which  are  automatically  compiled  by  the  CEM  Report  Generator  during  each 
model  execution.  These  output  reports  are  described  more  fully  in  CEM 
documentation  (Reference  5).  Each  of  the  14  theaterwide  MOEs  is  computed 
for  the  entire  Red  (German)  or  Blue  (US/UK)  force  for  each  of  the  eight  4-day 
theater  cycles  in  the  Ardennes  Campaign.  FEBA  advance  and  change  are 
arithmetically  averaged  over  all  CEM  avenues  of  advance  defined  in  the 
theater.  Ammunition  spent  is  measured  in  tons.  Permanent  personnel  losses 
include  killed,  captured,  missing,  and  patients  evacuated  from  theater. 
Permanent  tank  losses  include  only  killed  and  abandoned  systems.  Over  the 
32-day  campaign,  the  entire  group  comprises  exactly  1 12  MOE  values 
generated  by  deterministic  CEM,  and  also  during  each  STOCEM  replication. 
The  arithmetic  mean  value  over  all  30  replications  of  a  STOCEM  case  is  the 
primary  STOCEM  MOE  used  for  comparison  with  the  corresponding 
deterministic  CEM  result. 

The  group  denoted  as  FEBA  position  MOEs  is  defined  as  the  FEBA  progress 
(by  the  Germans)  along  each  of  the  21  active  avenues  of  advance  used  by 
forces  in  the  simulation.  Their  specific  configuration  is  described  in  ARCAS 
documentation.  Over  the  8  theater  cycles  of  the  full  campaign,  this  group 
comprises  exactly  168  MOE  values  generated  by  deterministic  CEM,  and 
during  each  STOCEM  replication.  The  arithmetic  mean  value  over  all  30 
STOCEM  replications  is  used  for  comparison  with  deterministic  CEM. 
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The  following  five  charts  show  example  MOE 
results  for  a  single  case  and  a  single  MOE. 


The  following  five  charts  show  example  “bottom  level”  graphic  results  used  to 
build  the  comparative  results  described  later.  Each  example  is  for  a  case 
defined  in  Chart  12  and  and  MOE  described  in  Chart  13. 
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STOCEM  mean  and  confidence  limits  for 
case  BO:  Blue  cumulative  permanent  tank  losses 


This  example  shows  the  STOCEM  means,  and  95  percent  confidence  limits, 
for  the  sampling  distribution  of  the  mean,  for  example  results  from  case  BO  for 
each  4-day  CEM  theater  cycle.  STOCEM  means  are  arithmetic  averages  over 
30  replications  in  the  case  (BO).  Confidence  limits  around  each  STOCEM 
mean  are  computed  using  the  Student  /-distribution.  The  “Blue”  force  denotes 
the  US/UK  in  ARCAS  results. 
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ENO  DAY  OF  PERIOD 


This  chart  shows  attributes  of  the  statistical  distribution  of  STOCEM  results 
for  the  case  depicted.  The  minimum/maximum  bounds,  and  the  25th/75th 
percentile  bounds  are  two  of  the  four  types  of  STOCEM  limit  bands  noted  in 


Chart  7. 


16 


CAA-MR-97-42 


THE  US  ARMrS  CENTER  FOR  STRATEGY  AND  FDRCE  EVALUATION 


Case  BO  vs  deterministic  CEM:  max/m  in  and  25-75  percentile 
limits  for  Blue  cumulative  permanent  tank  losses 


This  chart  shows  deterministic  CEM  results  for  the  cumulative  Blue  (US/UK) 
permanent  tank  loss  MOE  for  each  4-day  theater  cycle,  along  with: 

a.  The  corresponding  case  BO  STOCEM  mean  for  the  MOE  (over  30 
replications). 

b.  The  25th  percentile  limit  (labeled  25  PCT)  and  the  75th  percentile  limit 
(labeled  75  PCT)  for  the  case  BO  STOCEM  MOE  (over  30  replications). 

c.  The  minimum  bound  and  maximum  bound  for  the  case  BO  STOCEM 
MOE  (over  30  replications). 

This  chart  graphically  shows  example  comparative  results  for  two  of  the  four 
STOCEM  limit  bands  noted  in  Chart  7. 
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Case  BO  vs  deterministic  CEM:  99  %  confidence  limits  and 
STOCEM  mean  +- 15%  for  Blue  cumulative  permanent  tank  losses 
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This  chart  shows  deterministic  CEM  results  for  the  cumulative  permanent  Blue 
(US/UK)  tank  losses  MOE  for  each  4-day  theater  cycle,  along  with: 

a.  The  corresponding  case  B0  STOCEM  mean  for  the  MOE  (over  30 
replications). 

b.  The  99  percent  confidence  limit  band  around  the  case  B0  STOCEM  mean 
(over  30  replications). 

c.  The  values  of  [85  percent  of  the  B0  STOCEM  mean]  and  [115  percent  of 
the  B0  STOCEM  mean]  . 

This  chart  graphically  shows  example  comparative  results  for  two  of  the  four 
STOCEM  limit  bands  defined  in  Chart  7. 
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Case  BO  vs  deterministic  CEM:  max/m  in  and  25-75  percentile  limits 
for  FEBA  progress  on  D+12 
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The  deterministic  CEM  FEBA  cumulative  progress  on  D+12  is  plotted  in  this 
chart  for  each  of  the  21  STOCEM  avenues  of  advance,  which  are  indexed  left- 
to-right  corresponding  to  a  north-to-south  geographic  order.  The  magnitude  of 
the  FEBA  progress  is  plotted  for  each  avenue  of  advance.  The  D-day  (Day  1) 
position  is  at  the  0  ordinate,  and  a  negative  "km  from  D-day  FEBA" 
corresponds  to  a  German  advance.  This  linearized  representation  emulates  a 
quasi-geography  for  the  battle  with  relative  positions  along  the  STOCEM 
avenues  of  advance,  which  are  here  represented  as  parallel  straight  lines.  The 
orientation  is  from  an  stylized  aerial  perspective  facing  east  from  above 
US/UK  lines. 

a.  The  points  on  the  dashed  line  graphs  show  the  maximum  and  minimum 
(westernmost  and  easternmost)  case  B0  STOCEM  FEBA  progress  since  D-day 
over  the  30  replications. 

b.  Points  on  the  thin  solid  line  graphs  in  the  figure  (which  are  labeled  25  PCT 
and  75  PCT)  show  the  25th  percentile  limits  and  the  75th  percentile  limits  for 
the  distribution,  over  30  replications,  of  case  B0  STOCEM  FEBA  progress 
since  D-day,  in  kilometers  (km). 

This  chart  graphically  shows  example  comparative  results  for  two  of  the  four 
STOCEM  limit  bands  noted  in  Chart  7. 
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Bias  in  STOCEM  FEBA  movement  process 


*  The  STOCEM  FEBA  move  rate  process  is  probably  biased 
(having  a  different  mean)  relative  to  FEBA  move  rates 
generated  in  deterministic  CEM. 

J  Central  tendency  of  STOCEM  “rate  of  advance”  tables  was 
not  calibrated  to  deterministic  CEM  values. 

✓  All  other  STOCEM  processes  are  calibrated  to  same  mean 
as  deterministic  CEM  values. 

✓  FEBA  movement  bias  may  increase  divergence  from 
deterministic  CEM  FEBA  movement. 

•  Base  case  BO  and  case  CO  are  a  priori  not  preferred. 

✓  Results  are  generated  so  that  any  bias  may  be  exhibited. 


Conversion  of  a  deterministic  simulation  to  a  stochastic  form  is  conventionally 
done  by  defining  each  stochastic  process  as  a  statistical  distribution  with  a 
central  tendency  (usually  the  mean)  equal  to  either  an  input  of  the  deterministic 
model,  or  to  an  MOE  generated  in  the  deterministic  model.  This  calibration 
process  does  apply  to  all  of  the  stochastic  processes  of  STOCEM  except  the 
FEBA  move  rate  process.  Discussions  with  the  STOCEM  designer  indicate 
that  the  stochastic  FEBA  movement  process  in  STOCEM  was  based  on 
updated  historical  move  rate  data  and  that  no  attempt  was  made  to  calibrate  it 
to  the  move  rate  process  used  in  deterministic  CEM.  The  STOCEM  FEBA 
movement  is  therefore  probably  biased  to  an  unknown  degree,  relative  to 
FEBA  movement  in  deterministic  CEM.  Only  SICS  cases  BO  and  CO  activate 
the  STOCEM  FEBA  move  rate  stochastic  process.  Because  of  the  above  bias, 
these  two  cases  are  a  priori  not  suitable  for  comparison  with  deterministic 
CEM  to  assess  differences  due  to  alternative  COSAGE  sampling.  However, 
comparisons  for  these  cases  are  included  herein,  so  that  any  bias  may  be 
quantitatively  demonstrated. 
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The  following  three  charts  assess  overall  STOCEM 
results  for  the  14  theaterwide  MOEs  relative  to 
deterministic  CEM  results. 


The  chart  is  self-explanatory. 
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This  chart  shows  and  compares  nine  clusters  of  case  results,  corresponding  to, 
and  labeled  with,  the  names  of  the  nine  STOCEM  cases  studied.  BO  denotes 
the  base  STOCEM  case,  B1  through  B4  denote  the  variations  of  the  base,  in 
which  increasing  numbers  of  stochastic  STOCEM  processes  are  made 
deterministic.  The  cases  are  described/defined  in  Chart  12. 

Each  bar  of  each  case  result  cluster  shows  the  fraction  of  the  14  (MOEs)  x  8 
(theater  cycles)  =112  deterministic  CEM  theaterwide  MOE  results  for  that 
case  which  are  outside  of  the  STOCEM  limits  (from  Chart  7)  associated  with 
that  bar.  For  example,  the  leftmost  (striped)  bar  of  each  cluster  denotes  the  25- 
75  percentile  limits  of  the  case  (which  by  definition  bound  50  percent  of  the 
STOCEM  results  for  case).  Looking  at  BO,  we  see  that  the  ordinate,  77 
percent,  describes  the  fraction  of  the  112  deterministic  CEM  MOEs  which  are 
either  less  than  the  25  percentile  limit  or  greater  than  the  75  percentile  limit  for 
the  case.  Each  bar  type  can  be  compared  across  case  clusters.  A  low'  value 
indicates  less  divergence  relative  to  the  indicated  STOCEM  limits.  Each  small 
white  square  in  a  case  cluster  is  the  arithmetic  average  of  the  ordinates  for  the 
bars  in  that  cluster.  These  squares  are  labeled  as  “composite”  and  are 
connected  by  a  line  solely  for  ease  of  viewing. 

The  three  indicated/bracketed  cases.  Cl,  C2,  and  C4,  show  the  least  divergence 
and  are  hereafter  (in  this  briefing)  labeled,  and  denoted,  as  the  preferred  cases. 
These  use  the  alternative  COSAGE  sampling  and  exclude  (biased)  stochastic 
treatment  of  the  FEBA  move  rate  process. 
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Average  %  reduction  in  fraction  deterministic  CEM  MOEs 
outside  STOCEM  limits  relative  to  base  case  BO 
(  averaged  over  all  4  limit  types) 
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This  chart  also  shows  and  compares  results  for  nine  STOCEM  cases  studied. 
However  each  bar  of  each  case  result  cluster  here  is  associated  with  an  MOE 
type  rather  than  a  STOCEM  limit  type.  The  ordinate  of  each  bar  shows  the 
average  reduction,  relative  to  the  base  case  BO,  in  the  fraction  of  deterministic 
CEM  MOE  results,  of  the  specified  MOE  type  for  that  case,  which  are  outside 
of  STOCEM  limits.  Fraction  outside  STOCEM  limits  is  defined  as  the 
arithmetic  average  of  the  fractions  (outside  limits)  for  each  of  the  four  limit 
types.  The  “ALL  MOES”  value  in  a  case  cluster  is  the  arithmetic  average  of 
the  ordinates  for  the  four  bars  in  the  cluster  and  reflects  the  relative  change  (in 
terms  of  reduction)  relative  to  case  BO  in  the  case  values  for  the  composite 
limit  in  the  previous  chart.  For  example,  the  composite  fraction  outside  limits 
for  BO  in  the  previous  chart  was  .55  for  case  BO  and  .45  for  case  Bl.  For  case 
Bl,  this  reflects  a  reduction  of  10/55  =  .18  (=  18  percent)  relative  to  BO  and 
this  is  the  Bl  ordinate  for  “ALL  MOES”  in  this  chart. 

In  this  chart,  a  high  value  indicates  less  divergence  relative  to  the  associated 
STOCEM  limits. 

The  three  indicated  preferred  cases,  Cl,  C2,  and  C4,  show  the  least 
divergence.  These  use  the  alternative  COSAGE  sampling  and  exclude 
stochastic  treatment  of  the  FEBA  move  rate.  The  DCS  case,  which  has 
everything  stochastic  except  the  fixed  COSAGE  sample,  diverges  even  more 
than  the  base  case. 

The  biggest  reductions  are  associated  with  the  personnel  loss  MOEs.  The 
smallest  reductions  are  associated  with  the  “percent  in  posture”  MOEs. 
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Reduction  in  fraction  of  deterministic  CEM  MOEs  outside  (average)  limits 
achieved  by  preferred  cases  Cl,  C2  &  C4  relative  to  base  case  BO 


This  chart  compares  average  percent  reductions  in  the  fraction  outside 
STOCEM  limits,  relative  to  the  base  case  BO,  by  MOE  type,  for  only  the 
designated  (in  Charts  22  and  23)  preferred  cases  Cl,  C2,  and  C4.  These 
percent  reduction  values  are  from  the  previously  shown  chart  and  reflect 
averages  over  all  four  STOCEM  limit  types.  The  fraction  outside  limits  for  the 
base  case  BO  is  shown  in  the  inset  white  box  for  each  MOE  type.  Except  for 
posture  and  FEBA  MOEs,  there  are  only  small  differences  between  percent 
reduction  achieved  by  the  three  preferred  cases.  These  preferred  cases  ,  over 
all  14  theaterwide  MOEs,  yield  an  average  50  to  65  percent  reduction  in 
divergence  relative  to  the  base  case  BO.  However  for  the  FEBA  position 
MOEs,  these  three  preferred  cases,  using  alternative  COSAGE  sampling,  yield 
only  a  15  to  35  percent  average  reduction  in  divergence  measures. 
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The  following  five  charts  assess  STOCEM  results  for 
each  type  MOE  relative  to  deterministic  CEM  results 
over  the  14  theaterwide  MOEs. 


The  chart  is  self-explanatory. 
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Chart  22  showed  the  average  fraction  of  all  deterministic  CEM  theaterwide 
MOEs  outside  specified  STOCEM  limits  for  each  case.  This,  and  the  next  four 
charts,  show  the  average  fraction  outside  limits  only  for  the  MOEs  of  a  specific 
type  (chosen  from  the  14  theaterwide  MOEs  described  in  Chart  13).  This  chart 
shows  the  average  fraction  outside  limits  only  for  the  four  ammo  use  MOEs 
considered.  (This  comprises  32  deterministic  CEM  MOEs.)  The  nine  case 
clusters  are  in  exactly  the  same  format  as  shown  in  Chart  22. 

Each  bar  of  each  case  result  cluster  here  shows  the  fraction  of  the  4  x  8  =  32 
deterministic  CEM  ammo  use  MOE  results  for  that  case  which  are  outside  of 
the  STOCEM  limits  associated  with  that  bar.  The  leftmost  bar  of  each  cluster 
denotes  the  25-75  percentile  limits  of  the  case.  Looking  at  the  BO  case  cluster, 
we  see  that  the  ordinate  69  percent  describes  the  fraction  of  the  32 
deterministic  CEM  MOEs  which  are  either  less  than  the  25  percentile  limit  or 
greater  than  the  75  percentile  limit  for  the  case.  Each  bar  type  can  be 
compared  across  case  clusters.  A  low  value  indicates  less  divergence  relative 
to  the  indicated  STOCEM  limits.  In  this,  and  in  the  following  four  charts,  the 
white  square  in  each  case  cluster,  denoted  as  composite,  is  the  arithmetic 
average  of  the  ordinates  for  the  four  bars  in  the  case  cluster.  These  white 
squares  are  connected  by  a  line  solely  for  ease  of  viewing. 

The  three  indicated  preferred  cases  (showing  least  divergence  in  Charts  22  and 
23)  also  show  the  least  divergence  for  this  MOE  if  case  CO  is  excluded.  These 
preferred  cases  all  use  the  alternative  COSAGE  sampling. 
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Average  frequency  (over  2  tank  loss  MOEs) 
deterministic  CEM  is  outside  specified  STOCEM  limits  I 
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Each  bar  of  each  case  result  cluster  here  shows  the  fraction  of  the  2  x  8  =  16 
deterministic  CEM  tank  loss  theaterwide  MOE  results  for  that  case  which  are 
outside  of  the  STOCEM  limits  associated  with  that  bar.  Each  bar  type  can  be 
compared  across  case  clusters.  A  low  value  indicates  less  divergence  relative 
to  the  indicated  STOCEM  limits. 

The  three  indicated  preferred  cases,  Cl,  C2,  and  C4,  are  those  selected 
previously,  in  Charts  22  and  23,  as  displaying  least  overall  divergence.  For 
this  MOE  type,  divergence  of  the  preferred  cases  C2  and  C4  is  not  very 
different  from  their  B2  and  B4  counterparts. 

The  DCS  case,  which  activates  every  STOCEM  stochastic  process  except  the 
fixed  COSAGE  sample,  again  shows  substantial  divergence. 
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Each  bar  of  each  case  result  cluster  here  shows  the  fraction  of  the  2  x  8  =  16 
deterministic  CEM  personnel  loss  MOE  results  for  that  case  which  are  outside 
of  the  STOCEM  limits  associated  with  that  bar.  A  low  value  indicates  less 
divergence  relative  to  the  indicated  STOCEM  limits.  The  white  square  in 
each  cluster,  denoted  as  composite,  is  the  arithmetic  average  of  the  ordinates 
for  the  four  bars  in  the  case  cluster. 

The  three  indicated  preferred  cases,  Cl,  C2,  and  C4,  from  Charts  22  and  23, 
also  show  the  least  divergence  for  this  MOE. 

The  DCS  case,  which  has  everything  stochastic  except  the  fixed  COSAGE 
sample,  again  shows  substantial  divergence. 
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Average  frequency  (over  2  FEBA  change  theaterwide  MOEs) 
deterministic  CEM  is  outside  specified  STOCEM  limits 


BO  B1  B2  B4  CO  Cl  C2  C4  DCS 
CASE 


Each  bar  of  each  case  result  cluster  here  shows  the  fraction  of  the  2  x  8  =  16 
deterministic  CEM  “FEBA  change”  theaterwide  MOE  results  for  that  case 
which  are  outside  of  the  STOCEM  limits  associated  with  that  bar.  A  low  value 
indicates  less  divergence  relative  to  the  indicated  STOCEM  limits.  The  white 
square  in  each  case  cluster,  denoted  as  composite,  is  the  arithmetic  average  of 
the  ordinates  for  the  four  bars  in  the  cluster. 

The  three  indicated  preferred  cases,  Cl,  C2,  and  C4,  displaying  least 
divergence  in  Charts  22  and  23,  also  show  least  divergence  for  this  MOE  type. 
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Average  frequency  (over  4  posture  %  MOEs) 
deterministic  CEM  is  outside  specified  STOCEM  limits  I 
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Each  bar  of  each  case  result  cluster  here  shows  the  fraction  of  the  4  x  8  =  32 
deterministic  CEM  results  for  the  “percent  force  in  posture”  theaterwide  MOEs 
which  are  outside  of  the  STOCEM  limits  for  each  STOCEM  case  studied.  A 
low  value  indicates  less  divergence  relative  to  the  indicated  STOCEM  limits. 
The  white  square  in  each  case  cluster,  denoted  as  composite,  is  the  arithmetic 
average  of  the  ordinates  for  the  four  bars  in  the  cluster. 

The  three  indicated  preferred  cases,  Cl,  C2,  and  C4,  displaying  least 
divergence  in  Charts  22  and  23,  also  show  least  divergence  for  this  MOE  type, 
but  they  show  only  slightly  less  divergence  than  most  other  cases. 
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The  following  four  charts  assess  STOCEM  results  for 
the  FEBA  position  MOE  relative  to  deterministic  CEM 
results. 


This  chart  is  self-explanatory. 
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Average  frequency  (over  all  days) 


deterministic  CEM  FEBA  on 


an  avenue  of  advance  is  outside  specified  STOCEM  limits 
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Chart  22  showed  the  average  fraction  of  all  112  deterministic  CEM 
theaterwide  MOEs  outside  specified  STOCEM  limits  for  each  case.  This  chart 
shows  the  average  fraction  outside  limits  only  for  the  FEBA  position  MOE 
described  in  Chart  13.  It  shows  the  average  fraction  of  deterministic  CEM 
FEBA  position  MOE  results  lying  outside  each  of  the  specified  STOCEM 
limits  over  all  of  the  21  avenues  of  advance  in  the  theater  over  all  eight  4-day 
theater  cycles.  This  chart  has  the  same  format  as  was  used  in  Chart  22.  Only 
the  underlying  MOEs  are  different. 

Each  bar  of  each  case  result  cluster  here  shows  the  fraction  of  the  21  x  8  =  168 
deterministic  CEM  FEBA  position  MOE  results  for  that  case  which  are  outside 
of  the  STOCEM  limits  associated  with  that  bar.  Again,  the  leftmost  bar  of 
each  case  cluster  denotes  the  25-75  percentile  limits  of  the  case.  Each  bar 
type  can  be  compared  across  case  clusters.  A  low  value  indicates  less 
divergence  relative  to  the  indicated  STOCEM  limits.  The  white  square  in  each 
cluster,  denoted  as  “overall  average,”  is  the  arithmetic  average  of  the  ordinates 
for  the  four  bars  in  the  case  cluster.  These  white  squares  are  connected  by  a 
line  solely  for  ease  of  viewing. 

The  three  indicated  preferred  cases,  Cl,  C2,  and  C4,  are  those  which  showed 
least  overall  divergence  in  Chart  22.  These  use  the  alternative  COSAGE 
sampling  and  exclude  (biased)  stochastic  treatment  of  the  FEBA  movement. 
For  this  MOE,  these  cases  exhibit  only  slightly  less  divergence,  on  average, 
than  their  counterpart  cases  Bl,  B2,  and  B4 
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This  chart  also  compares  case  results  over  the  nine  STOCEM  cases  studied, 
but  each  bar  of  each  case  result  cluster  here  is  associated  with  a  scenario 
timeframe  rather  than  with  a  STOCEM  limit  type.  Specifically,  the  ordinate  of 
each  bar  shows  the  average  percent  reduction,  relative  to  the  base  case  BO,  in 
the  fraction  of  the  deterministic  CEM  FEBA  position  results  for  that  case 
which  are  outside  of  STOCEM  limits  for  the  indicated  scenario  timeframe. 
Fraction  outside  STOCEM  limits  is  defined  here  as  the  arithmetic  average  of 
the  fractions  (outside  limits)  for  each  of  the  four  limit  types.  The  white 
squares  labeled  “ALL  DAYS,”  and  connected  by  a  line,  reflect  the  relative 
change  (in  terms  of  reduction)  relative  to  case  BO  over  the  entire  scenario.  For 
example,  the  overall  average  fraction  outside  limits  for  BO  in  the  previous 
chart  was  .32  for  case  BO  and  .25  for  case  B2.  For  case  B2  this  reflects  a 
reduction  of  .07/.32  =  .21  relative  to  BO  and  this  is  the  B1  ordinate  for  “ALL 
DAYS”  in  this  chart.  In  this  chart,  a  high  value  indicates  less  divergence. 

The  three  indicated  preferred  cases  are  those  selected  previously,  showing  least 
divergence  in  Charts  22  and  23.  These  use  the  alternative  COSAGE  sampling 
and  exclude  (biased)  stochastic  treatment  of  the  FEBA  move  rate.  Here,  they 
achieve  somewhat  greater  reduction  in  average  divergence  than  their  Bl,  B2, 
and  B4  counterparts.  The  DCS  case,  which  activates  all  STOCEM  stochastic 
processes  except  the  fixed  COSAGE  sample,  shows  a  negative  divergence 
reduction,  indicating  it  has  more  divergence  than  the  base  BO  case.  This  is  also 
true  of  case  CO,  and  probably  is  substantially  due  to  the  bias  in  the  FEBA 
move  rate  stochastic  process,  which  is  active  only  in  cases  BO,  CO,  and  DCS. 
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Reduction  in  fraction  of  deterministic  CEM  FEBA  positions  outside  limits 
for  preferred  cases  Cl,  C2  &  C4  relative  to  base  case  BO 
(averaged  over  all  4  limit  types) 
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This  chart  compares  average  percent  reductions  in  fraction  outside  STOCEM 
limits  relative  to  the  base  case  B0  for  only  the  preferred  cases  Cl,  C2,  and  C4. 
These  percent  reduction  values  are  from  the  previously  shown  chart.  The 
fraction  outside  limits  for  the  base  case  B0  is  also  shown  in  the  inset  white  box 
for  each  timeframe.  Percent  reduction  is  arithmetically  averaged  over  all  four 
STOCEM  limit  types.  These  preferred  cases,  over  all  168  FEBA  position 
MOEs,  yield  an  average  15  to  35  percent  reduction  in  divergence  relative  to 
the  base  case  B0  over  the  entire  scenario. 
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Observations  on  assessment  of  STOCEM 
divergence  from  deterministic  CEM 

14  Theaterwide  MOEs 


✓  Best  cases  use  alternative  COSAGE  sampling  &  have  average  50  • 
65  percent  reduction  in  divergence  measures. 

/  Best  case  (65  percent  reduction)  C4  has  only  one  activated 
stochastic  process  (COSAGE  sampling) 

y  Case  Cl  (50  percent  reduction)  has  all  stochastic  processes 
activated  except  FEBA  movement. 


FEBA  position  MOEs 

✓  Best  cases  use  alternative  COSAGE  sampling  &  have  average  15  - 
35  percent  reduction  in  divergence  measures. 

✓  Best  case  C4  has  30  •  35  percent  average  reduction. 

✓  Case  Cl  has  average  15  percent  reduction. 

/  Biased  case  CO  diverges  severely. 


This  chart  summarizes  observations  made  in  previously  exhibited  charts. 
Percent  reduction  here  refers  to  arithmetically  averaged  reduction,  relative  to 
BO,  in  the  frequency  of  deterministic  CEM  MOE  results  lying  outside  the  four 
STOCEM  limit  bands  described  in  Chart  7.  The  higher  the  percent  reduction 
(in  divergence)  achieved,  the  better  is  the  case  result  relative  to  the  SICS 
objectives. 
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The  following  three  charts  assess  STOCEM  variation 
(over  replications)  in  STOCEM  results. 


Recall,  from  Chart  5,  that  one  objective  of  SICS  was  to  seek  an  increase  in 
variability,  over  replications,  of  STOCEM  MOEs,  except  for  those  MOEs 
reflecting  FEBA  progress. 
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This  chart  shows,  for  each  STOCEM  case  studied,  the  ratio  of  the  average 
standard  deviation  of  STOCEM  MOE  results  for  that  case  to  the  average 
standard  deviation  for  the  base  BO  case.  For  each  of  the  14  theaterwide  MOE 
case  values  in  each  4-day  theater  cycle,  the  sample  standard  deviation  is 
computed  over  the  30  replication  results  of  that  MOE.  After  this  standard 
deviation  is  computed  for  all  cases,  the  normalized  MOE  ratio  for  each 
case/theater  cycle  is  computed  as  ratio  of  the  case  standard  deviation  to  the 
standard  deviation  for  the  base  case  BO  in  that  theater  cycle.  For  each  case, 
these  normalized  ratios  are  then  arithmetically  averaged  over  all  MOEs  and 
theater  cycles  to  yield  the  value  plotted  in  this  chart. 

From  the  chart,  the  average  STOCEM  variability,  over  replications,  in  the  14 
theaterwide  MOEs,  for  all  of  the  cases  with  alternative  COSAGE  sampling  is 
approximately  double  that  of  the  base  case  BO.  Cases  B2  and  B4  show  an 
approximate  33  percent  reduction  in  average  variability  relative  to  the  base 
case  BO.  The  B1  and  DCS  cases  have  essentially  the  same  average  variability 
as  the  base  case. 
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Average  standard  deviation  (km)  in  STOCEM  mean  FEBA 
progress  since  D-day  [FEBA  position  MOE] 


This  chart  shows,  for  each  STOCEM  case  studied,  the  average  standard 
deviation  of  STOCEM  FEBA  position  MOE  results  for  that  case,  in  terms  of 
km  advanced  since  D-day  (Day  1  of  the  scenario).  For  each  case,  a  sample 
standard  deviation  was  computed  for  FEBA  progress  on  each  of  the  21  CEM 
avenues  of  advance  in  each  4-day  theater  cycle.  Each  case  value  plotted  on 
this  chart  shows  the  arithmetic  average  of  the  standard  deviations,  computed 
for  that  case,  over  all  21  avenues  of  advance  and  all  theater  cycles  in  the 
associated  scenario  timeframe. 

From  the  chart,  differences  in  average  STOCEM  FEBA  progress  variability, 
over  cases  are  small.  The  average  standard  deviation  over  the  full  scenario 
ranges  from  around  5  km  in  cases  B2  and  B4  to  about  8.5  km  in  case  CO. 
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Average  %  increase  in  standard  deviation  (over  replications) 
of  STOCEM  MOEs  for  cases  Cl,  C2,  &  C4  relative  to  base  case  BO 
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This  chart  compares  average  percent  increase  in  standard  deviation  (over 
replications)  of  STOCEM  cases  results  for  cases  Cl,  C2,  and  C4  in  Charts  37 
and  38,  by  MOE  category,  relative  to  the  base  case  BO.  Those  cases  were 
designated  as  preferred  based  on  divergence  (deterministic  vs  stochastic) 
reduction  criteria.  Percent  increase  is  arithmetically  averaged  over  all  MOEs 
in  a  category. 

The  average  standard  deviation  of  FEBA  position  MOEs  for  these  preferred 
cases  is  within  10  percent  of  that  for  the  base  case  BO. 

For  the  14  theaterwide  MOEs,  the  average  standard  deviation  of  the  preferred 
case  results  is  essentially  double  that  of  the  base  case. 
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Observations  on  assessment  of  STOCEM 
variability  (standard  deviation)  over  replications 


•  14  theaterwide  MOEs 

✓  All  cases  with  alternative  COSAGE  sampling  [CO,  Cl,  C2,  and  C4] 
have  almost  a  100  percent  increase  in  variability  in  standard 
deviation  over  replications  (relative  to  base  case). 

•  FEBA  position  MOEs 

✓  Cases  Cl,  C2,  and  C4  [using  alternative  COSAGE  sampling]  have 
essentially  the  same  variability  in  standard  deviation  over 
replications  as  the  base  case. 


This  chart  is  self-explanatory  and  reflects  results  described  in  Charts  38  and 
39. 
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Recommendations 


•  Use  alternative  COSAGE  sampling  (one  posture  sample  drawn 
in  each  replication)  to  reduce  STOCEM  divergence  from 
deterministic  CEM. 

✓  Best  compromise  is  to  stochastically  activate  all  STOCEM 
processes  except  FEBA  movement  because  this  option: 

-  has  many  processes  stochastic 

-  has  only  slightly  more  divergence  than  activating  only  the 
(alternative)  COSAGE  sampling  process. 

✓  Variability  in  non-FEBA  results  is  also  increased. 

•  Do  not  use  stochastic  FEBA  movement  process  until  it  is 
calibrated  to  deterministic  CEM. 

•  Confirm  SICS  results  with  further  tests. 


One  objective  of  SICS  is  to  reduce  divergence  of  STOCEM  results  from 
deterministic  CEM  results.  Charts  23  and  33  show  that,  on  average,  cases  Cl, 
C2,  and  C4,  achieve  the  greatest  divergence  reductions.  C4  showed  greater 
average  reduction  than  C2,  and  C2  showed  greater  average  reduction  than  Cl . 
However,  the  percent  reduction  was  of  similar  magnitude  over  these  preferred 
cases.  Since  Cl  applies  more  stochastic  processes  than  either  C2  or  C3,  it 
appears  to  be  more  desirable  than  C2  or  C4,  because  it  better  reflects  actual 
combat,  in  which  virtually  all  processes  are  stochastic. 

A  second  objective  of  SICS  is  to  increase  the  variability,  over  replications,  of 
STOCEM  results  for  non-FEBA  MOEs,  i.e.,  those  MOEs  that  do  not  measure 
FEBA  progress.  The  results  in  Charts  37  and  38  show  that  cases  Cl,  C2,  and 
C4  all  essentially  produce  a  100  percent  increase  in  average  variability  for  the 
14  theaterwide  MOEs,  relative  to  the  base  case  BO,  while  leaving  average 
variability  essentially  unchanged  for  the  FEBA  progress  MOEs. 

Overall,  case  Cl  appears  to  be  preferred  for  STOCEM  application. 

Chart  20  noted  that  the  STOCEM  FEBA  movement  process  is  biased  relative 
to  deterministic  CEM  because  it  was  not  calibrated  around  deterministic  CEM 
inputs.  Because  of  this  bias,  STOCEM  should  not  be  applied  with  an  active 
FEBA  move  rate  process  until  calibration  is  done. 

Since  all  STOCEM  results  shown  herein  are  based  only  on  the  ARCAS 
scenario,  and  reflect  a  single  sample  of  30  replications  per  case,  additional 
experimentation  with  new  scenarios  and  samples  is  desirable. 
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The  following  ten  charts  assess  STOCEM  results 
using  alternative  sampling  for  closeness  to  historical 
Ardennes  Campaign  results. 


This  chart  is  self-explanatory. 
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Both  historical  results  and  STOCEM  case  results  for  60  replications  were 
determined  at  the  end  of  each  4-day  theater  cycle  during  the  32-day  campaign  for 
the  combat  MOEs  noted  in  the  above  chart.  Historical  results  are  derived  from 
the  Ardennes  Campaign  Simulation  Data  Base  (ACSDB).  The  percent  error  in 
the  STOCEM  mean  value  relative  to  history  is  computed  for  each  MOE  value  as 
the  absolute  value  of:  [  (history  -  STOCEM  mean)/(history)  ]  for  each  STOCEM 
replication  and  theater  cycle.  The  average  percent  error  for  an  MOE  is  the 
arithmetic  average  of  the  percent  error  for  the  MOE  over  all  eight  theater  cycle 
values  and  all  60  replications.  Only  eight  of  the  14  theaterwide  MOEs  described 
in  Chart  1 3  are  represented  in  the  above  chart  because  historical  baseline  data 
have  not  been  compiled  for  the  other  six  MOEs. 

The  only  cases  compared  in  each  case  cluster  are  deterministic  CEM  (DET 
CEM),  the  base  case,  BO,  and  those  STOCEM  cases  in  chart  12  which  apply 
alternative  COSAGE  sampling.  The  rightmost  cluster,  labeled  OVERALL,  plots 
the  arithmetic  average  of  the  eight  MOE  values  plotted  to  the  left. 

German  MOEs  produced  the  largest  average  discrepancies  (percent  error) 
between  history  and  STOCEM.  Overall,  cases  C2,  and  C4  qualify  as  best  cases, 
having  the  lowest  average  discrepancies  from  history  (OVERALL  percent  error 
of  39  percent  each).  Case  CO  is  the  worst  case,  having  the  largest  average 
discrepancy  (45  percent).  All  other  cases  have  average  OVERALL  percent  error 
between  41  percent  and  44  percent.  Statistical  confidence  level  of  OVERALL 
differences  between  STOCEM  cases  is  discussed  in  the  next  chart. 
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Confidence  levels  of  case  differences  in  overall  percent  error 
(case  1  compared  to  case  2) 
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This  chart  treats  the  statistical  confidence  level  of  differences  between  paired 
OVERALL  means  shown  in  the  previous  chart.  Each  case  1  OVERALL  mean 
(MOE  percent  error  relative  to  history)  was  subtracted  from  each  case  2 
OVERALL  mean.  This  difference  in  case  means  was  then  tested  for  the 
statistical  confidence  associated  with  accepting  the  hypothesis  that  it  is 
different  from  zero,  i.e.,  that  the  means  represent  different  statistical 
populations.  For  a  sample  of  size  60  (replications),  the  sampling  distribution 
of  differences  in  means  can  be  treated  as  normally  distributed.  The  resulting 
statistical  confidence  levels  associated  with  (accepting)  the  difference  between 
case  means  are  plotted  in  the  above  chart.  The  closer  a  confidence  level  is  to 
1 .00,  the  higher  the  level  of  assurance  that  the  associated  difference  is 
statistically  significant.  For  example,  the  leftmost  bar  of  the  “  CASE  1  =  BO” 
cluster  indicates  that  the  difference  between  the  case  CO  OVERALL  mean  and 
the  case  BO  OVERALL  mean,  as  shown  in  the  OVERALL  cluster  of  Chart  43, 
is  statistically  significant  at  the  .92  confidence  level.  This  is  the  same  as  the 
ordinate  of  the  BO  (leftmost)  bar  in  the  cluster  for  case  1  equal  to  CO. 

This  chart  supports  the  best  case/worst  case  designations  made  in  Chart  43. 
Confidence  level  test  results  indicate  that,  relative  to  OVERALL  means  shown 
in  chart  43,  the  best  cases,  C2  and  C4,  are  not  significantly  different  from  each 
other,  and  these  cases  both  differ  from  cases  BO,  Cl,  CO,  and  DET  CEM,  with 
a  confidence  level  above  .99.  The  worst  case,  CO,  differs  from  case  Cl  with 
.74  confidence  level,  and  from  all  other  cases  with  at  least  .92  confidence. 
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Average  fraction  of  STOCEM  MOEs  closer  to  history  than  BO 
(by  type  combat  MOE) 
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For  the  specified  SICS  STOCEM  cases,  this  chart  shows,  for  each  STOCEM 
case,  the  fraction  of  MOE  values  which  are  closer  to  history  (based  on  the 
ACSDB)  than  corresponding  MOE  values  from  the  base  case,  BO.  Closeness 
to  history  for  an  MOE  type  is  in  terms  of  the  absolute  difference  between 
history  and  a  corresponding  STOCEM  result,  and  is  assessed,  and  averaged, 
over  individual  theater  cycle  results  of  60  STOCEM  replications.  The  MOE 
types  are  the  same  as  in  Chart  43.  The  cases  compared  are  deterministic  CEM, 
and  those  STOCEM  cases  in  Chart  12  which  apply  alternative  COSAGE 
sampling.  The  rightmost  cluster,  labeled  OVERALL,  plots  the  arithmetic 
average  of  the  eight  MOE  values  plotted  to  the  left. 

Overall,  deterministic  CEM  qualifies  as  the  best  case,  having  the  largest 
OVERALL  fraction  (55  percent)  of  MOE  values  closer  to  history  than  base 
case  BO.  Case  CO  is  the  worst  case,  having  only  44  percent  closer  to  history 
than  BO.  Only  cases  C2,  C4,  and  deterministic  CEM,  with  overall  fractions 
exceeding  .50,  are  closer  to  history  than  the  base  case  BO.  Statistical 
confidence  levels  associated  with  OVERALL  differences  between  STOCEM 
cases  are  discussed  in  the  next  chart. 
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Confidence  levels  of  case  differences  in  fraction  combat  MOEs 


closer  to  history  Than  BO  (case  1  compared  to  case  2) 


0.90 

0.80 

0.70 

0.60 

0.50 

0.40 

0.30 

0.20 

0.10 

0.00 


This  chart  treats  the  statistical  confidence  level  associated  with  differences 
between  paired  OVERALL  means  (for  fraction  closer  to  history  than  BO) 
shown  in  the  previous  chart.  Exactly  analogous  to  Chart  44,  each  difference 
(case  1  OVERALL  mean  vs  case  2  OVERALL  mean)  was  tested  for  the 
statistical  confidence  level  associated  with  accepting  the  hypothesis  that  it  is 
different  from  zero,  i.e.,  that  the  means  represent  different  statistical 
populations.  The  sampling  distribution  of  differences  in  means  is  again  treated 
as  normally  distributed.  The  confidence  levels  associated  with  (accepting)  the 
differences  between  paired  case  OVERALL  means  are  plotted  in  the  above 
chart. 

This  chart  supports  the  best  case/worst  case  designations  made  in  Chart  45. 
Confidence  level  test  results  indicate  that,  relative  to  OVERALL  means 
depicted  in  Chart  45,  the  best  case,  deterministic  CEM,  is  not  significantly 
different  from  cases  C2  and  C4,  and  these  cases  both  differ  from  cases  CO  and 
Cl  with  a  confidence  level  above  .99.  The  worst  case,  CO,  is  not  statistically 
distinguishable  from  case  Cl,  since  the  difference  has  only  a  .52  confidence 
level.  However,  both  case  CO  and  Cl  differ  from  the  other  three  cases  with  a 
confidence  level  exceeding  .99. 
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For  selected  SICS  cases,  both  historical  results  and  STOCEM  FEBA  position 
MOE  results  were  determined  for  each  of  21  avenues  of  advance  in  the 
STOCEM  theater  at  the  end  of  each  4-day  theater  cycle.  The  absolute 
difference  between  history  and  a  STOCEM  case  result,  is  in  terms  of  km 
advanced  since  D-day.  The  average  km  deviation  from  history  for  each  4-day 
period  was  computed  as  the  arithmetic  average,  over  60  STOCEM  replications, 
of  the  absolute  differences,  in  each  4-day  period,  over  all  21  avenues  of 
advance.  The  only  cases  compared  in  each  cluster  are  deterministic  CEM,  the 
base  case,  BO,  and  those  STOCEM  cases  in  chart  12  which  apply  alternative 
COSAGE  sampling.  The  rightmost  cluster,  labeled  OVERALL  plots  the 
arithmetic  average  of  the  eight  MOE  values  plotted  to  the  left. 

Case  CO  qualifies  as  the  the  best  case,  having  the  smallest  average  OVERALL 
deviation  (from  history)  of  18.3  km.  Deterministic  CEM  is  the  worst  case, 
having  the  largest  discrepancy  between  history  and  STOCEM,  an  OVERALL 
deviation  of  19.5  km.  Statistical  confidence  levels  associated  with  OVERALL 
differences  between  STOCEM  cases  are  discussed  in  the  next  chart. 
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Confidence  levels  of  case  differences 
in  overall  km  deviation  of  FEBA  (case  1  compared  to  case  2) 


This  chart  treats  the  statistical  confidence  level  of  differences  between  paired 
OVERALL  means  (for  km  deviation  from  history)  shown  in  the  previous 
chart.  Each  difference  (case  1  OVERALL  mean  vs  case  2  OVERALL  mean) 
was  assessed  for  the  statistical  confidence  level  associated  with  accepting  the 
hypothesis  that  it  is  different  from  zero,  i.e.,  that  the  means  represent  different 
statistical  populations.  The  sampling  distribution  of  differences  in  means  is 
again  treated  as  normally  distributed.  The  resulting  confidence  level 
associated  with  (accepting)  the  difference  between  paired  case  OVERALL 
means  is  plotted  in  the  above  chart. 

These  results  indicate  that,  relative  to  OVERALL  means  depicted  in  chart  47, 
the  assessed  best  case,  CO,  differs  from  case  C2  with  a  .72  confidence  level, 
from  case  BO  with  a  .79  confidence  level,  and  from  cases  Cl,  C4,  and 
deterministic  CEM  with  at  least  a  .88  confidence  level.  This  provides  qualified 
support  to  the  best  case  designation  assigned  to  CO  in  Chart  47.  The  assessed 
worst  case,  deterministic  CEM,  differs  from  all  other  cases  with  at  least  a  .99 
confidence  level.  This  strongly  supports  the  worst  case  assessment  assigned  to 
deterministic  CEM  in  Chart  47. 

Case  BO  and  the  best  case,  CO,  are  statistically  similar  (differing  only  at  the  .79 
confidence  level).  BO  and  CO  are  also  the  only  cases  using  the  stochastic 
FEBA  move  process.  These  results  therefore  suggest  that  the  STOCEM 
stochastic  FEBA  move  process  may  be  a  better  one,  relative  to  history,  than  is 
the  FEBA  movement  process  used  in  deterministic  CEM. 
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Average  fraction  of  STOCEM  FEBAs  closer  to  history 
than  base  BO 
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Exactly  168  FEB  A  position  MOE  values  (for  each  of  21  avenues  of  advance 
and  of  eight  4-day  periods)  were  computed  for  each  FEBA  position  MOE  for 
each  STOCEM  case  and  for  the  history  baseline  (from  the  ACSDB).  For  the 
specified  STOCEM  cases,  this  chart  shows  the  fraction  of  each  case’s  FEBA 
position  MOE  values  which  are  closer  to  history  than  the  corresponding 
values  for  the  base  case  B0.  Closeness  to  history  is  in  terms  of  the  absolute 
difference  between  history  and  a  corresponding  STOCEM  result,  and  is 
assessed,  and  averaged,  over  individual  theater  cycle  results  of  60  STOCEM 
replications.  The  cases  compared  are  deterministic  CEM,  and  those  STOCEM 
cases  in  chart  12  which  apply  alternative  COSAGE  sampling.  The  rightmost 
cluster,  labeled  OVERALL  plots  the  arithmetic  average  of  the  eight  MOE 
values  plotted  to  the  left. 

Overall,  case  CO  is  the  best  case,  having  the  largest  OVERALL  fraction  (.4 1 ) 
closer  to  history  than  base  case  B0.  Deterministic  CEM  (.35)  is  the  is  worst 
case.  All  other  cases  have  average  OVERALL  percent  error  between  .36  and 
.39.  All  depicted  fractions  are  considerably  less  than  .50  because 
approximately  14  percent  of  STOCEM  MOES  are  equal  ( to  zero)  over  all 
cases.  This  occurs  because  the  STOCEM  FEBA  retreat  along  each  avenue  of 
advance  is  constrained  to  stop  at  the  D-day  FEBA  positions  (0  km  advance)  in 
all  cases.  Statistical  confidence  levels  of  OVERALL  differences  between 
STOCEM  case  means  are  discussed  in  the  next  chart. 
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This  chart  treats  the  statistical  confidence  level  of  differences  between  paired 
OVERALL  means  (for  fraction  closer  to  history  than  BO)  shown  in  the 
previous  chart.  Each  difference  (case  1  OVERALL  mean  vs  case  2  OVERALL 
mean)  was  tested  for  the  statistical  confidence  level  associated  with  accepting 
the  hypothesis  that  it  is  different  from  zero,  i.e.,  that  the  means  represent 
different  statistical  populations.  The  sampling  distribution  of  differences  in 
means  is  again  treated  as  normally  distributed.  The  resulting  confidence  levels 
associated  with  (accepting)  the  difference  between  paired  case  OVERALL 
means  are  plotted  in  the  above  chart. 

This  chart  supports  the  best  case/worst  case  designations  made  in  Chart  49. 
Confidence  level  test  results  indicate  that,  relative  to  OVERALL  means 
depicted  in  Chart  49,  the  best  case,  CO,  statistically  differs  from  case  C2  with  a 
.85  confidence  level,  and  from  all  other  cases  with  at  least  a  .95  confidence 
level.  The  worst  case,  deterministic  CEM,  differs  from  case  Cl  with  only  a  .72 
confidence  level,  but  differs  from  all  other  cases  with  a  confidence  level 
exceeding  .99.  Cases  C2  and  C4  appear  to  be  very  similar  statistically 
(associated  confidence  level  of  difference  =  .41 ).  Some  uncertainty  might  be 
resolved  by  additional  sampling. 
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Summary  observations  on  closeness  to  history 
over  the  eight  combat  MOES 

•  Best  case  results  (closest  to  history): 

✓ Cases  C2  and  C4  have  lowest  average  percent  deviation  from 
history. 

-  Difference  from  other  cases  is  significant  (>.99  confidence) 
V' Deterministic  CEM  has  the  largest  fraction  of  MOE  values 

which  are  closer  to  history  than  base  BO. 

-  Difference  from  C2  and  C4  is  not  statistically  significant. 

-  Difference  from  CO  and  Cl  is  significant  (>.99  confidence). 

•  Worst  case  results  (furthest  from  history): 

SCase  CO  has  largest  average  percent  deviation  from  history. 

-  Difference  from  BO  and  Cl  has  modest  (.74-.92)  confidence. 

-  Difference  from  C4,  C2,  and  DET  CEM  is  significant  (>.99) . 
✓  Case  CO  has  lowest  fraction  MOEs  closer  to  history  than 


This  chart  summarizes  results  already  described  in  Charts  43  through  46. 
Using  a  “closeness  to  history”  criterion  with  the  OVERALL  combat  MOE 
results,  STOCEM  cases  C2  and  C4  were  preferred  since  they  had  the  lowest 
overall  percent  deviation  from  history.  Case  C2  and  C4  were  also  jointly 
preferred,  along  with  deterministic  CEM,  under  the  criterion  of  having  the 
largest  fraction  of  combat  MOE  values  which  are  closer  to  history  than  those 
for  the  base  case,  BO. 

Case  CO  was  the  least  preferred  case  under  both  criteria.  CO  was  statistically 
similar  to  case  Cl,  but  differed  with  high  confidence  from  other  cases. 
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Summary  observations  on  closeness  to  history 
over  the  FEBA  position  MOEs 

•  Best  case  results  (closest  to  history): 

/ Case  CO  has  lowest  average  divergence  from  history. 

-  Difference  from  BO  and  C2  weakly  significant  (<.79  conf). 

-  Difference  from  cases  Cl,  C4,  and  deterministic  CEM  is 
significant  (.88  -  .99  confidence  level). 

/Case  CO  has  largest  fraction  MOEs  closer  to  history  than  BO. 

•  Worst  case  results  (furthest  from  history): 

/Deterministic  CEM  case  has  largest  divergence  from  history. 

-  Statistically  different  from  all  other  cases  (>.99  confidence). 
/Deterministic  CEM  has  lowest  fraction  MOEs  closer  to  history 

than  base  BO. 

-  Difference  from  Cl  is  only  weakly  significant  (.72  conf). 

-  Statistically  different  from  other  cases  (>.99  confident 


This  chart  summarizes  results  already  described  in  Charts  47  through  50. 

Using  a  “closeness  to  history”  criterion  with  the  OVERALL  FEBA  position 
MOEs,  STOCEM  case  CO  was  most  preferred,  having  the  lowest  overall 
percent  deviation  from  history,  but  this  case  was  not  strongly  differentiated 
from  cases  BO  and  C2.  CO  was  also  the  best  case  under  the  criterion  of  having 
the  largest  fraction  of  combat  MOE  values  closer  to  history  than  the  base  case, 
BO.  Under  this  criterion,  CO  differs  from  case  C2  with  .85  confidence  and 
from  all  other  cases  with  at  least  .95  confidence. 

Deterministic  CEM  was  the  least  preferred  case  under  both  criteria.  This 
nonpreference  was  strongly  differentiated  statistically  (>.99  confidence)  in 
almost  all  cases.  Deterministic  CEM  differed  weakly  (.72  confidence)  from 
case  Cl  in  the  overall  fraction  of  combat  MOE  values  closer  to  history  than  the 
base  case,  BO. 
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Consolidated  observations  and  recommendations 


Initial  (Chart  41)  recommendation  was  to  use  case  Cl : 


•/  Use  alternative  COSAGE  sampling  (1  posture  sampie  drawn  in 
each  replication)  to  reduce  STOCEM  divergence  from 
deterministic  CEM. 


✓  Stochasticaiiy  activate  all  STOCEM  processes  except  FEBA 
movement. 


•/  Cases  Cl,  C2,  and  C4  ail  have  similar  preference  relative  to 
divergence  from  deterministic  CEM  and  output  variability. 

•  History  comparison  prefers  use  of  alternative  case  C2. 

✓  Stochastically  activate  all  STOCEM  processes  except  FEBA 
movement  and  decision  thresholds. 

✓  C2  has  iowest  average  percent  error  over  eight  combat  MOEs. 

•  History  FEBA  comparison  suggests  calibrating  deterministic 
CEM  FEBA  move  process  to  stochastic  STOCEM  process. 


This  charts  summarizes  results  shown  in  Charts  51  and  52  and  uses  them  to 
qualify  the  recommendations  in  Chart  41 .  Based  on  the  objectives  of  reducing 
STOCEM  divergence  from  deterministic  CEM  and  of  increasing  variability  in 
non -FEB A  results,  cases  Cl,  C2,  and  C4  are  almost  equally  preferred.  Chart 
41  recommends  use  of  case  Cl  chiefly  because  it  activates  the  largest  number 
cf  stochastic  processes.  The  historical  comparison  suggests,  with  high 
statistical  confidence,  that  case  C2  is  most  preferred  because  it  produces  the 
smallest  percent  deviation  from  history  over  the  eight  combat  MOEs  in  the 
scenario  examined.  Case  C2  uses  alternative  COSAGE  sampling,  but  does  not 
use  a  stochastic  FEBA  movement  process  or  stochastic  decision  threshold 
processes. 

Additionally,  the  comparison  with  historical  FEBA  progress  indicates,  with 
only  modest  statistical  confidence,  that  STOCEM  FEBA  results  with  the 
stochastic  FEBA  movement  process  are  closer  to  history  than  results  using  the 
deterministic  CEM  FEBA  movement  process.  Since  the  STOCEM  FEBA 
movement  process  was  not  calibrated  around  the  deterministic  CEM  process, 
these  results  suggest  that  deterministic  CEM  should  perhaps  be  “backward- 
calibrated”  to  reflect  the  stochastic  FEBA  movement  process  of  STOCEM. 

Further  investigation  may  be  warranted  in  view  of  the  limited  nature  of  the 
scenario  and  samples  examined.  Testing  and  assessment  with  additional 
sample  replications  may  increase  confidence  differences  that  were  only  weakly 
significant  in  these  results. 
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several  methods  for  using  ARCAS  COSAGE  samples  in  STOCEM  In  support  of  this  planning,  SICS  will  execute 
STOCEM  with  several  different  stochastic  sampling  techniques  applied  to  the  COSAGE  samples  used  in  ARCAS,  and 
will  compare  average  STOCEM  outcome  results  and  ranges  of  outcome  variation  Results  will  guide  the  use  of  COSAGE 
samples  in  KOSAVE  and  will  be  of  interest  to  ail  users  of  STOCEM 


15.  Studv  Director/POC: 


Last  Name  Bauman 


First:  Walter 


Signature:  h/o. 


Date: 


02/28/97 


Phone#:  295-5261 


TO  BLOCK  20  If  this  is  A  STUDY .  See  Tab  C  of  the  Study  Directors’  Guide 
for  preparation  of  a  Formal  Study  Directive. 


16.  Background/Statement  of  Problem*:  The  range  of  variation  in  STOCEM  outcomes  in  ARCAS  was  often  small.  There 
is  a  need  to  investigate  whether  variability  in  COSAGE  samples  is  insufficiently  represented  in  the  ARCAS  methodology 
in  order  to  plan  for  effective  use  of  COSAGE  samples  in  the  ROSAVE  study. 


17.  Scope  of  Work*:  Formulation  of  sampling  methods  to  be  studied.  Construction  of  STOCEM  inputs  to  sample 
ARCAS  COSAGE  samples  using  these  methods  Formulation  of  MOE’s  studied.  Modification  of  STOCEM  output 
processors  to  process  results  Execution  of  30  replications  of  STOCEM  for  each  method  .  Comparison,  analysis,  and 
documentation  of  results  from  each  method. 


18.  Issues  for  Analysis*:  How  does  the  average  STOCEM  result  vary  using  each  COSAGE  sampling  method?  How 
does  the  range  of  STOCEM  outcome  results  vary  using  each  sampling  method7  What  sampling  method  is  preferred? 


19.  Milestones/Plan  of  Action*:  Define  problem  and  methods  -  15  March  Develop  STOCEM  inputs  and  modify 
postprocessors  - 15  April.  Complete  STOCEM  executions  15  May.  Complete  analysis  - 1  July  Brief  ARB  30  July. 
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APPENDIX  D 

HISTORY  VS  STOCEM  MEAN  COMBAT  MOEs  IN  EACH  4-DAY  PERIOD 


OVERVIEW.  Figures  D-l  through  D-8  show  historical  results  and  mean  STOCEM  results 
averaged  over  two  samples  of  30  replications  at  the  end  of  each  4-day  theater  cycle  for  eight 
combat  MOEs.  Only  eight  of  the  14  theaterwide  MOEs  described  in  Chart  13  were  suitable  for 
comparison  because  historical  baseline  data  had  not  been  compiled  for  the  other  six  MOEs.  The 
cases  depicted  are  deterministic  CEM,  the  base  STOCEM  case,  BO,  and  STOCEM  cases  CO,  Cl, 
C2,  and  C4,  which  apply  alternative  COSAGE  sampling. 
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Figure  D-3.  Average  German  Ammunition  Consumed  in  Each  Period 
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Figure  D-5.  Average  Cumulative  US/UK  Permanent  Tank  Losses 
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Figure  D-6.  Average  Cumulative  German  Permanent  Tank  Losses 
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Figure  D-7.  Average  US/UK  Permanent  Personnel  Casualties  in  Each  Period 
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Figure  D-8.  Cumulative  US/UK  Permanent  Personnel  Casualties  in  Each  Period 
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APPENDIX  E 

HISTORY  VS  STOCEM  MEAN  FEBA  POSITION  MOEs  IN  EACH  4-DAY  PERIOD 


OVERVIEW.  Figures  E-l  through  E-8  show  historical  results  and  mean  STOCEM  FEBA 
progress  results,  averaged  over  two  samples  of  30  replications,  along  each  STOCEM  avenue  of 
advance  at  the  end  of  each  4-day  theater  cycle.  The  21  avenues  of  advance  are  the  same  as  were 
used  in  ARCAS.  For  modeling  purposes,  the  STOCEM  theater  area  is  overlaid  with  a  system  of 
21  movement  corridors,  denoted  herein  as  CEM  “avenues  of  advance,”  corresponding  to  the 
initially  planned  flow  of  forces  in  STOCEM  during  the  campaign.  These  avenues  are  serially 
indexed  in  a  north-to-south  geographic  ordering  as  avenue  10  through  avenue  30.  The 
magnitude  of  the  cumulative  FEBA  progress  since  D-day  (Day  1  of  the  scenario)  is  plotted  for 
each  avenue  of  advance.  The  D-day  position  is  at  the  0  ordinate,  and  a  negative  “km  from  D-day 
FEBA”  corresponds  to  a  German  advance.  This  linearized  representation  emulates  a  quasi¬ 
geography  for  the  battle  with  relative  positions  along  the  (north-south  ordered)  STOCEM 
avenues  of  advance  represented  as  parallel  straight  lines.  The  orientation  is  from  an  aerial 
perspective  facing  east  from  above  US/UK  lines.  The  cases  depicted  are  deterministic  CEM,  the 
base  STOCEM  case,  BO,  and  STOCEM  cases  CO,  Cl,  C2,  and  C4,  which  apply  alternative 
COSAGE  sampling. 
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Figure  E-l.  FEBA  Positions  on  D+4 
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Figure  E-2.  FEBA  Positions  on  D+8 
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Figure  E-3.  FEBA  Positions  on  D+12 
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Figure  E-4.  FEB  A  Positions  on  D+l  6 
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Figure  E-5.  FEBA  Positions  on  D+20 
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Figure  E-6.  FEBA  Positions  on  D+24 
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Figure  E-7.  FEBA  Positions  on  D+28 
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GLOSSARY 

1.  ABBREVIATIONS,  ACRONYMS,  AND  SHORT  TERMS 


ACSDB 

Ardennes  Campaign  Simulation  Data  Base 

ADDCOP 

Automated  Data  Display  of  CEM  Outputs 

ALT 

alternative 

ARCAS 

Ardennes  Campaign  Simulation  (study) 

CAA 

US  Army  Concepts  Analysis  Agency 

CAS 

casualties 

CUM 

cumulative 

CEM 

Concepts  Evaluation  Model  (simulation) 

CS 

COSAGE  sampling  (stochastic  process) 

D-day  day  1  (of  campaign  scenario) 
DET  CEM  deterministic  CEM  (case) 


DNBI 

disease  and  nonbattle  injuries 

DT 

decision  threshold  (stochastic  process) 

FEBA 

forward  edge  of  the  battle  area 

FM 

FEBA  movement  (stochastic  process) 

GE 

German 

KOSAVE 

Kursk  Operation  and  Simulation  and  Validation  Exercise 
(study) 

km 

kilometer(s) 

max 

maximum 

min 

minimum 

MOE 

measure(s)  of  effectiveness 

PCT 

PER 

percentile 

personnel 

RAA 

research  analysis  activity 
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SEACA 

Simulation  Enhancements  from  the  Ardennes  Campaign 
(RAA) 

SICS 

STOCEM  Investigation  of  Combat  Sampling  (RAA) 

STO 

STOCEM  or  stochastic 

STOCEM 

Stochastic  CEM  (simulation) 

TC 

theater  cycle 

Tk 

tank 

US 

United  States 

UK  United  Kingdom 

2.  MODELS,  ROUTINES,  AND  SIMULATIONS 


CEM  IX 

Concepts  Evaluation  Model  IX  -  a  two-sided,  fully 
automated,  deterministic  model  capable  of  aggregating 
conventional  warfare  results  as  a  series  of  4-day  theater- 
level  cycles 

COSAGE 

Combat  Sample  Generator  -  a  two-sided,  stochastic,  high- 
resolution  (division  level)  simulation  model  which 
simulates  a  day’s  combat  activity  to  generate  ammunition 
consumption  and  equipment  and  personnel  loss  data 

STOCEM 

Stochastic  Concepts  Evaluation  Model  -  a  stochastic 
version  of  CEM  IX,  a  two-sided,  fully  automated  model 
capable  of  aggregating  conventional  warfare  results  as  a 
series  of  4-day  theater-level  cycles 
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